منابع مشابه
Statistical mechanics of ensemble learning
Within the context of learning a rule from examples, we study the general characteristics of learning with ensembles. The generalization performance achieved by a simple model ensemble of linear students is calculated exactly in the thermodynamic limit of a large number of input components and shows a surprisingly rich behavior. Our main findings are the following. For learning in large ensembl...
متن کاملStatistical Mechanics of Time Domain Ensemble Learning
Conventional ensemble learning combines students in the space domain. On the other hand, in this paper we combine students in the time domain and call it time domain ensemble learning. In this paper, we analyze the generalization performance of time domain ensemble learning in the framework of online learning using a statistical mechanical method. We treat a model in which both the teacher and ...
متن کاملStatistical Mechanics of Nonlinear On-line Learning for Ensemble Teachers
Department of Electronic Engineering, Kobe City College of Technology, 8–3 Gakuen-higashimachi, Nishi-ku, Kobe, 651–2194 2 Department of Electrical and Electronic Engineering, Faculty of Engineering, Kobe University, 1–1, Rokkodai, Nada-ku, Kobe 657–8501 Division of Transdisciplinary Sciences, Graduate School of Frontier Sciences, The University of Tokyo, 5–1–5 Kashiwanoha, Kashiwa-shi, Chiba, ...
متن کاملStatistical Mechanics of Learning
We review the application of statistical mechanics methods to the study of online learning of a drifting concept in the limit of large systems. The model where a feed-forward network learns from examples generated by a time dependent teacher of the same architecture is analyzed. The best possible generalization ability is determined exactly, through the use of a variational method. The construc...
متن کاملStatistical mechanics in the extended Gaussian ensemble.
The extended Gaussian ensemble (EGE) is introduced as a generalization of the canonical ensemble. This ensemble is a further extension of the Gaussian ensemble introduced by Hetherington [J. Low Temp. Phys. 66, 145 (1987)]. The statistical mechanical formalism is derived both from the analysis of the system attached to a finite reservoir and from the maximum statistical entropy principle. The p...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Physical Review E
سال: 1997
ISSN: 1063-651X,1095-3787
DOI: 10.1103/physreve.55.811